Workflow

demo of cookie_dc project template

Snakemake Reports

Detailed software versions can be found under Rules.

Results

Workflow resultes
File Size Description Job properties
plot_jup_nb.html 295.1 kB
Job properties
Ruleplot_nb_2_html
plot_rmd_shell.html 1.5 MB
Job properties
Ruleplot_rmd_shell
plot_rmd_shell.png 962.9 kB
Job properties
Ruleplot_rmd_shell
plot_rmd_snakemake.html 1.5 MB
Job properties
Ruleplot_rmd_snakemake

Statistics

If the workflow has been executed in cluster/cloud, runtimes include the waiting time in the queue.

Configuration

Configuration files
File Code
config/config.yml
 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
# test --------------------------------------------------------

fail_check_on: "warning" # "error", "warning", "note"
lint: true

# document------------------------------------------------------

rules_to_report:
  - "exec"
  - "test"
  - "job"


# config files -------------------------------------------------
# if multiple config files are used snakemake merges them and keys can't be duplicated
# if multiple large config files are needed by scripts it is better to pass the files directly

config_files:
  exec: "config/config_exec.yml"
config/config.yml
 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
# test --------------------------------------------------------

fail_check_on: "warning" # "error", "warning", "note"
lint: true

# document------------------------------------------------------

rules_to_report:
  - "exec"
  - "test"
  - "job"


# config files -------------------------------------------------
# if multiple config files are used snakemake merges them and keys can't be duplicated
# if multiple large config files are needed by scripts it is better to pass the files directly

config_files:
  exec: "config/config_exec.yml"

Rules

Workflow rules
Rule Jobs Output Singularity Conda environment Code
plot_rmd_snakemake 1
  • docs/html/plot_rmd_snakemake.html
source
plot_rmd_shell 1
  • docs/html/plot_rmd_shell.html
  • docs/png/plot_rmd_shell.png
1
R -e 'wd = getwd();                 rmarkdown::render( "{input[0]}",                     output_file = normalizePath( paste0( wd,"/" ,"{output[0]}" ) ),                     params = list(input = "{input[1]}",                                    output = "{output[1]}" ),                     knit_root_dir = getwd(),                     envir = new.env() )'         
plot_nb_2_html 1
  • docs/html/plot_jup_nb.html
1
jupyter nbconvert --to html {input} --output ../../../{output}
load_dataset 1
  • data/out/feather/data.feather
 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
import seaborn as sns
import pandas as pd
import yaml

with open(snakemake.config["config_files"]["exec"], 'r') as f:
    params = yaml.safe_load(f)

df = sns.load_dataset(params['dataset'])

df.to_feather(snakemake.output[0])

print('load finished')
plot_execute_nb_plot 1
  • src/nb/executed/plot.ipynb
1
python -c 'import papermill as pm;             pm.execute_notebook(  "{input[0]}"                     , "{output[0]}"                     , parameters = dict( input = "{input[1]}") )'